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TKLhVISION AND OTUM DETERMINANTS OF SCHOLASTIC ACHICTIMENT 
IN MEXICAN SECONDARY EDUCATION 



As many nations' school systems begin to feel the dual pressure of 
increased enrollment demand and a scarcity of available funds and/or 
critical resources for their educational system , there develops growing 
interest in the possibility of finding more efficient educational tech- 
niques. Among developing nations, where these pressures have been rising 
for as long as two decades, a number of countries have been expressing 
their concern, in part, by experimenting with the relatively new educational 
media of radio and television. This study attempts to evaluate some of the 
results of one such experiment in Mexico. The primary focus here will be 
on the ability of the media to increase student language and mathematical 
achievement* Secondarily we will look at the effect of other school sys- 
tem and student inputs to the learning process. Examination of this system's 
costs and other possible system outputs have been treated elsewhere,^ but 
will be discusser' briefly^ at the conclusion. 

2/ 

The Telesecundaria System 

In 1965 the number of primary school graduates unable to enter secondary 

school in Mexico is over l80,000, or approximately 37 percent of the previous 

year's sixth grade graduates. The lack of opportunity at the secondary level 

was most acute in the rural areas where there have not been sufficient funds 

traditional (Ensenanza Directa-(ro) ) 

to provide eithery^secondary schoolsAor qualified teaching personnel. In answe 
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to this problem, the Telesecundaria (TS) system was developed, beginning open 
circuit instructional television broadcasts to approximately 65OO seventh 
graders in 1968, and expanding to cover almost 30,000 students in all three 
grades by 19T3. The system covers an eight state, 100,000 square mile re- 
gion around Mexico City, with its 30,000 students representing about 5 percent 
of the total secondary student enrollment in the region. Television car- 
ries the primary instructional burden of the system in all subjects (about 
10 subjects per grade) by delivering one twenty-minute program every hour 
to each classroom at all three grade levels. Each student therefore re- 
ceives about 360 hours of televised instruction a year, which is one-third 
of his or her time spent in school. The telesecundaria ciirriculum is de- 
signed to parallel and replicate that of the traditional secondary system, 

3/ 

Primary school teachers, initially called monitors, and now referred 
to as coordinators, are supplied by the federal government to prepare the 
students for the televised lessons and provide review after a broadcast. 
Over time it appears that the televised lessons and the accompanying teacher 
guides have enabled many of these coordinators to sufficiently master the 
subject matters to encourage them to break away from the traditional drill 
and repetition practice they were intitially conceived of as performing ( see 
Mayo, McAnany, and Kleeb (l9T3) and Mayo (l9T3l) 

School buildings and facilities (including television reception equip- 
ment) are supplied by the locality (unlike the traditional system in which 
such facilities are provided by the government), which requests the initiation 
of a tele-school in its community. These facilities usually provide inferior 
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instructional resources (excluding the television receiver) to those pro- 
vided in the traditional secondary school system. Generally, Telesecun- 
daria serves more rural areas than the traditional system, although a 
number of urban areas that already have secondary schools have opened 
tele-sohools to meet the burgeoning demand for more educational opportuni- 
ties • At present, the future of the telesccundaria system - whether it 
will be expanded, dropped, or radically changed - is open to question; hope- 
fully, this research can contribute to the formation of an answer by Mexican 
educational policy makers, as well as contribute to other researchers and 
policy makers investigating possible uses of educational technology. 

Methodology 

The primary goal of this study is an attempt to examine the compara- 
tive efficacy of instructional television (ITV) with that of traditional in- 
struction (TI) in the Mexican secondary school system. Secondarily, we are 
interested in the relative efficacy of other school resources. The measure 
of objectives used will be cognitive achievement in language and mathematics* 
The use of these outputs as principal" measures of system effectiveness, is 
directly in line with the expressed goals of Telesecundaria poJicy makers 
(from conversations and documents). 

During the last fifteen years, a great many studies have been done 
comparing the use of various instructional media with traditional face-to-face 
instruction in a variety of educational evironments. There have been a nuimber 
of re'^atively recent and thorough reviews of the literature comparing the ef- 
fectiveness of televised instruction and traditional instruction with regard 
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to student achievcraent (and other output variables as well), so we will 
not attempt to repeat the process here (see Jamison > Suppes, and Wells 
(I97li), Schrairira (1973, Chapter 3), Dubin and Hedley (1969), Chu and 
Schramm (196T), and Stickell (19^3)).'^ Briefly, while some studies show 
an advantage for ITV, and other for TI, by and large the general finding 
has been that no significant statistical difference exirts in measured ef f^ctivene^^s. 
The conclusion reached by Janiison, et,. al. (l9T^, P 38) that "ITV can 
teach all grade levels and subject matters about as effectively as TI 
seems well documented. However, the crucial word is "can*'; that is, al- 
though we are pretty certain ITV and TI are subst itutable in a variety of 
situation^?, the question in the minds of Mexican educators was 'is it work- 
ing here?' Further doubts were added by the fact that most of the compara- 
tive studies have been carried out in the United States and other industrial- 
ized mass-media cultures, and there are obvious questions as to their trans- 
ferability, Relatively little careful work has been done examing the compara- 
tive effectiveness of ITV with TI in developing countries, although the media 

in many of these countries* 

is widely used in a variety of educational settings* The evidence that ve 

A 

do have, is reviewed in Schramm (1973) and for an excellent longitudinal analysis 
of the effectiveness of ITV in secondary schooling in El Salvador (perhaps one 
of the projects most similar to Mexico's) the reader is referred to Hornik,et_, al. 
(1973). 

The studies reviewed in most of the sources cited above were controlled 
experiments (although Stickell (1963) questioned the rigor of the designs of many); 
therefore the method of comparative analysis was usually a t-test of the signi- 
ficance of differences in mean outcomes. The results of such a comparison 
between the ITV and TI systems will be discussed in the following section, but 
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the reliability of a simple comparison of moan outcomes in a field study 
Bituatinn^as opposed to an experimentally controlled one, are extremely 
questionable. Even in an experimental comparison, it is difficult to con- 
trol the treatment so as to eliminate all possible confounding variables, 
and to do so In the field is next to impossible. The next best solution in 
the latter iiituation is to attempt to control for likely confounding varia- 
bles in the data analysis by appropriate choices of statistical procedures. 
A number of related statistical methods are possible - analysis of variance, 
■partial correlation analysis, path analysis, multiple regression analysis - 

V 

depending on the type of output measure desired and the type of assumptions 

\ 

the analyst is willing to make about the structure of the system. 

Given the goals of this study, multiple regression analysis was selected 
as the most appropriate statistical technique. We will attempt tp estimate 
the production function for the secondary schooling process and in so doing, 
to see if television and other selected variables contribute significantly to 
the acquisition of language and mathematics achievement and, additionally, try 
to gain some understanding of the education process itself. 

Educational Production Function Analysis 

A production function is a technical relationship that describes the trans- 
formation process by which system outputs are produced from system inputs, usu- 
ally applied by economists to private market firms or industries. Application 
of production function analysis to educational systems is a relatively recent 
phenomenon, stemming perhaps largely from the interest generated and the data 

made available by the U.S. Office of Education's survey on equality of educa- 

et. al. 

tional opportunity (see Coleman^^(l966) ) . In a number of respects, the utilization 
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of production functions in educational system analysis has problems pre- 
sent that are not usually encountered in firm analysis > although Bowles 
(1970) is probably correct when he points out that the data base avail- 
able for schools is somewhat better than that for firms; 

[W]e have data at the "firm" [school] level and there- 
fore avoid the problem of making "technological" inferences 
based on industrial > state, or national averages; most of our 
input data are measured directly, rather than in monetary ag- 
gregates; and ve have ample data on the quality of the factors 
of production e.g. teachers, principals, and other school 
personnel, [p. 13] 

However , 

there are both conceptual and measurement problems related to the 
description of educational system outputs and inputs. On the output 
side, a school may be considered a multi-product firm with inputs that 
are sometimes indivisible among outputs. For example, a teacher with 
certain characteristics may be instructing student£^* in the elements of 
the Spanish language and at the same time conveying certain ideas and at- 
titudes about discipline, authority, motivation, social customs, culture, 
and histoiy. If one only examines the effectiveness of various teacher 
characteristics on Spanish language performance, then resulting resource 
allocation recommendations may be dysfunctional with respect to the other 
unmeasured outputs. This problem is compounded by uncertainty as to what 
outputs schools are producing, what outputs they are supposed to produce, 
and how to reasonably measure any of them. 

Keeping in mind the limitations above, we will still confine our- 
selves to language and mathematics achievement as the output measures t.x- 
amined in this study (other outcomes of the Mexican TI and ITV secondary 
system are examined elsewhere - see footnote l). The multiple output 
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problem is considerably less serious at the secondary level > vrliero teachers 
are subject specific, than at the primai^y level where the same teacher may 

give instruction in a large number of subject areas. 

with educational' production function analysis 
Perhaps the most serious di f f iculty^is the lack of a theory of learn- 
ing and instruction that is sufficiently developed to enable us to identify 

both the relevant inputs and the structural form of the input-output trans- 
7 

formation. Given this lack of knowledge of the educational process, com- 
bined with the lack of incentives administrators have to even attempt to 
maximally produce specified outputs, it is unlikely that any estimated 
function will truly represent the production frontier . The theory of pro- 
duction assuines firm profit maximazat ion, which implies that a production 
function is a frontier function in the sense that it represents the maximum 
output that can be produced by the firm with alternative sets of given in- 
puts. A firm that produces on its frontier is said to be technically ef 
f icient ; schools are usually seen as technically inefficient. 

Efficiency . At this point, it seems 'Important to digress for a few moments and 

briefly look into the oft-times confused notion of efficiency. Traditional 

9 

economics is often considered the science of efficiency; unfortunately, 
the literature abounds with different and sometimes contradictory concep- 
tions of efficiency. The most agreed upon is a lloc a 'f -ive e fficiency which 
refer? to choosing the optimum input structure, given the specific input- 
output relationship and input prices; in a firm this is defined by the mar- 

10 

ginal conditions necessary for profit maximization. 

Leibenstein (1966) introduced the concept of X-cf f icicncy , which is 
conunonly used interchangably with technical efficien cy as defined above. 
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Technical efficiency is often considered a technical or engineering prob- 
lem as opposed to an economic one (see Render .n and Quandt (1958), Levin 
and Mulier (197M) in that it pertains to knowledge of the input-output 



^Technical inefficiency is usually seen to come about through ignor- 
ance of the correct production function or through organizational and moti- 
vational deficiencies^ that is, the inputs are there, they are Just not put 
together correctly^ in contrast to allocative inefficiency whereby the wrong 
inputs are pur chased. ^"^ 

Allocative and technical efficiency are necessary {and sufficient) 
conditions for a firm to be profit maximizing, sometimes referred to as 
economic efficiency . Regarding economic efficiency as discretionary (i.e. 
management can decide whether a firm will profit maximize), a somewhat 
different concept of efficiency is added by Wells (19T^) and Jamison and 
Suppes (1972), termed technological ef f iciency > to get at the differences 

ability to profit-maximize (or alternatively^ differences in the produc- 
tion possibilities) between firms* One firm is considered more technolo- 
gically efficient than another (usually in the context of the firms being 
in the same industry) if it has the ability to produce more profits (or 
output) given a set of inputs. 

Technological efficiency can be viewed as the inter-firm extension 
of technical efficiency (the latter as defined above > applies within the 
firm). Lau and Yotopoulos (l97l), Timmer (1970), Massell (I967), Brown 
(1966), and others have pointed out that firms may differ in their produc- 
tion abilities due to factors outside management's control - patent rights, 

location, climate, technology used, etcetera j these would be the assumed 

12 

basis for differences in technological efficiency* 
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Production function analysis generally assumes firms are technically 

efficient and that there is no difference in technological efficiency be- 
13 

tween firms. This allows the analyst to make recommendations specific 
to allocative efficiency. When firms are not equally technologically ef- 
ficient, it is not acceptable to use one production function specifica- 
tion across firms for different firms may well have different input-output 
relationships. When firms are not technically efficient, the options open 
to management can be much greater than those implied by production func- 
tion analysis. For example, although the production function analysis might 
imply a school should hire more experienced teachers as opposed to more ed- 
ucated teachers, if the school was technically inefficient, it might be more 
productive to attempt to give stronger motivation to teachers already on the 

staff* This latter recommendation would not usually be discernible from 

. Ik 

production function analysis. 

To isolate differences in technical efficiency (and perhaps technolo- 
gical efficiency as veil) a common practice is to estimate a separate pro- 
duction function for "best practice" firms j that is, those firms that seem 
to be operating closer to the production frontier (see Aigner and Chu (1968), 
Salter (l960))« Levin (l9T^) shows that not doing so may yield resource 
allocation recommendations that might actually reduce the productivity of 
some firms (schools) ."^^ However, it would seem that Michaelson (l9T0) is 
correct when he argues that although average production function relationships 
(based on the total data set) may not be too useful to firm mana/^ers (eg, 
school principals and superintendants) , they can be quite useful to a body 
that determines system policy. The practical point is that although system - 
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vide policies may be dysfunctional in some individual cases, average 
relationships do provide a reasonable indication of the probable re- 
sults of implementing system-wide changes, "^^ It is certainly true that 
educational policy that takes account of local conditions can yield more 
effective results than uniform policy, but very often in developing coun- 
tries uniform policy is the practical rule and it seems valid to be con- 
cerned with improving it. Furthermore, it is possible that the additional 
costs of information and administration necessary to make and administer 
local-varient policies could make this endeavor less cost-effective than 
uniform policy-making. 

In summary, one has to be careful in making efficiency recommenda- 
tions based on average production function estimation. However, there 
does seem to be reasonable expectations that significant system policy in- 
sights can emerge. Therefore this procedure is atteifi.pted below, although 
caution should be taken in interpreting the results. 

The Model . As we previously mentioned, the theory of how knowledge 
and attitudes are tranf erred, has not developed far enough to provide any 
clear specification for a model of classroom instruction, Attempts to 
model the education production process have relied on a combination of com- 
mon sense and the conventional wisdom of educators. Perhaps the most sophis- 
ticated, general model that implicitly or explicitly has been the basis for 

much of the most recent educational production function work, is the one 

17 

developed by Hanushek (1968) . In essence it is a capital embodiment ap- 
proach in that a ''child's achievement performance is determined by the cumula- 
tive amounts of "capital" (achievement] embodied in him by his fanily, his 

(Levin (1970, p.6l}) 

school, his community, and peers as well as his innate traits". The mathematical 

A 

formulation is as follows: 
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(l) 



\t " ^ L^^^i^)' ^i(t)' ^i(^)' ^^0 



tvl^vc d'ha i subscript rarers to tho itb £3tudont, the t sub- 
script refc;rs co tine poriod "t, and tho t subscript in pc-.r^w^ 
theses (t) refers to being curaulative to time period t, Thu&: 

A., « a vector of cduccitional outcor:Gs for the. s cut-en t 

J^t A 

at tine t; 

a vector of individual an^ family background 

i(t) 

characteristics cumulative to tirr.e t, 

S. , , = a vector of school inputs relevant to the ith 
x(t) 

student curaulativo to tir.io t. 

p., a vector of peer or fellow student characteriscics 
i{t) 

cumulative to t« 

l(t) A 
to the ith student cumulative to t. 

^ vector of initial or innate endowment of the 
ith student at t. 

(Levin (1970, p. 61 )) 

-^It is generally further assumed that all first partial derivatives (mar- 
ginal products) are positive; that is, additions to the quantity or quality 
of any of these resources will increase student performance. 

Tlie logic of the model seems reasonable enough (see Levin (1970) 'for de- 
tails), but unfortunately its generality precludes its being too infonnative. 
Tho primaiy problems are to determine which specific measurable input variables 
are relevant to the output(s) under .scrutiny and what specific functional form 
to estimate. 

The outputs examined will be measures of cognitive achievement in mathe- 
matics and language* Since we are interested in the role of schooling in 
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developing these cognitive outcomes, we would like to focus our attention 
on the value added to these two dimen«;ions of achievement by the school pro- 
cess. Therefore it is more appropriate to consider changes in achievement 
over time than the student's absolute level of achievement. However, due 
to greater reliability problems in the use of change scores, we will follow 
the advice of Cronbach and FUrby (1970) who suggest that one better approach 
is to still use achievement level> that is, post-test scores, as the dependent 
variable of analysis and control for the initially different starting posi- 
tions by using pre-test scores as an independent variable. 

The inputs considered will be a range of individual ^ family, community, 
and school characteristics that one would expect, both logically and on the 

4 

basis of previous studies, to influence the formation of these cognitive out- 
puts (see Table 2 in the following section for specifics). However, it must 
be remembered that the input measures used are very often proxy measures of 
the underlying attributes of the input variables which affect changes in 
achieveL^ent level. For example, an input measure that has shown a relatively 
high degree of effect on student outcomes in many studies is the teacher *s 
score on a verbal test (see Jaraison, Suppes , and Wells (l97^) for a review) • 
It is quite likely though that teacher verbal score itself is not the influen- 
tial factor, but that it is a proxy for certain teacher characteristics, such 
as general intelligence perhaps, that influence student outcomes- In these 
circiunstances > allocative efficie icy recommendations to hire teachers with 
higher verbal scores may be misleading; prospective teachers could study to 
increase their verbal score and not change the underlying attribute (e.g. genera 
intelligence) from which student improvement is generated. Despite this, it is 
still informative to examine the effects of the proxy input variable measures on 
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student outcomes, froia the standpoint of in*:reasing oar knowledge about the 
schooling process, but perhaps even more fron the realization that decisions 
to utilize certain inputs are themselves currently based on the proxy of 
the true input attributes* For example, teachers are very often hired and 
paid according to their experience and degree level, both of which are 
tacitly assujned proxies for their underlying teaching ability. It is useful 
to discover whether these proxy variables actually have a positive effect on 
student outcomes. 

Choosing an appropriate functional form for equation (l) is difficult. 
The lack of an adequate macro theory of instruction has encouraged most edu- 
cational resee.rchers analyzing school production relationships to utilize 

a linear formulation^ described mathematically as follows: 

n 

(2) Y biXi where Y represents the output under study, 

1=0 

Xj^ reprsents the n inputs, i=lj«^-n, 
and " ^ 

Although the linear model has the advantage of being easily interpretable - 

the estimated coefficients are input marginal pi'oducts -it does have serious 

logical shortcomings. Primarily it assumes the marginal product of any output 

is constant and consequently, that the elasticity of substitution among inputs 
l8 

is infinite. Therefore, technically the linear model would advise tlie de- 
cision maker to buy on]y that input with the highest marginal product per dollar 
cost (of the input) and abandon the use of all other inputs. Although these 
implications are logically untenable, most users of the linear formulation would 
counter that the model probably shows the directional effect of changes in in- 
puts on output and possibly gives reasonable results on the magnitude of that 
change for marginal (i.e. small) changes in input variables. 
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A multiplicative model, in some senses, is more intuitively appeal- 
ing. It allows for diminishing marginal products and interactions among 
inputs. It may be represented mathematically as follows: 

(3) Y = ir aXj^^i where Y represents the output under study 

i^l and Xi represents the n inputs, i=jl,.,.jn," 

The parameters of the model are easily estimatable by conventional least 
squares techniques since the eqiration is linear in logarithmic form. Although 1^ 

■ ■ 19 ■ . 

marginal products are not directly discernible , the estimated coefficients 
are conveniently interpretable as elasticities of output; that is, the per 
cent change in the dependent variable resulting from a one per cent change 
in an independent variable. 

Unfortunately, the multiplicative model also has some logical difficul- 
ties* Although marginal products vary, elasticity of output is constant, so 
that regardless of the level of an input, let's say teacher experience, a 10^ 
increase in that input would increase output by 10^. This assumption may be 
somewhat more tenable than that of constant marginal products, but it is still 
restrictive. Furthermore, positive values of all inputs are necessary to sus- 
tain a non-zero output; thai it?, all. inputs are considered essential by the 
nature of the formulation. For many analyses this may not be a serious practi- 
cal problem since the relevant ranges of the data are usually positive for all 
variables. However, it does sometimes necessitate rescaling of survey response 
items or in the case of employing a dummy (a zero or one value) variable, the 
form may be modified as follows: 

{h) Y = ae^J^J n X^^i where Y represents the output under study, 

i=l Xj^ represents the n-1 inputs, i=l , . . .j 
l^J J+l,...n, 

and Xj represents the dummy variable 



By taking the logarithm of both sides of equation ('0^ we can use stan- 
dard least squares procedure to estimate (U) in the following form: 

n 

(5) In Y = In a + tjXj+ S bilnXj. 

i=l 

Of course there are an infinite number of different possible func- 
tional forms which may be utilized. Forms other than the linear and multi- 
plicative have been tried rarely in educational settings, due primarily to 

complexities of estimation and the lack of theory to guide in making a reason- 
22 

able choice. Given the considerations above, the multiplicative model 
seems somewhat more appealing than the linear model; however, without a theo- 
retical model of instruction to guide us, it may be better procedure to choose 
on the basis of goodness of fit to the data. Rao and Miller (l9 ) describe 
a method for comparing linear and log linear models on the basis of the re- 
sidual sxim of squares, after an appropriate standardization transformation of 
the dependent variable in the latter model; this test was performed on several 
sublets of the data and the resultant variance explained of the two models 
were reasonably close. Tlierefore the multiplicative model was chosen as most 
appropriate based on the considerations above and the results reported will 
be estimations of the parameters of equation (h) (estimated in the form of ($))• 

The Data 

The data available was collected as a part of a collaborative evaluation 
effort on the part of the Audiovisual Deparbnent of the llexican Secretariat 
of Public Education and the Institute for ComjriUnica.tion Research at Stanford 
University. Information was gathered on four dimensions of the television 
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and traditional systems: student characteristics, teacher characteristics, 
school and community characteristics, and costs. 

Table 

Student Samples by Area and Instructional System 
Distrlto Valle de 

Federal Mexico Hl dalf^o More los 

^ TS ED TSED T^ ED 

)h. of Classes 15 10 15 k 15 ^ 13 5 

Hd. of Students 38iJ ^62 313 208 252 I83 28? 2^18 

Average Class Size 26 hS 21 52. 1? l\5 22 l\9 

Totals Telesecundaria Ensenanza Directa 

58 classes 23 classes 

1236 students 1101 students 

21 average class size average class size 



The four sampled states were chosen from among the eight in 
''•hich TS exists. This \ias done after an analysis of test scores, 
indicated that these four adequately represented the range ,pf 
achievement in all TS classes. The ED sample, although random, 
Is not representative of all ED schools throughout Mexico. Hov-j- 
^'Ver, since ED and TS classes were sampled randomly from the 
^^iff^e states^ comparisons within the four state region are valid* 

The data> as is shown in Table 1, was based on raiidora sainples of ninth 
grade classes > stratified by four geographical regions: the Federal District 
of Mexico and the stateSof Mexico, Hidalgo ^ and Morelos. Only one f,rade level 
was sampled due to resource limitations of the study; ninth grade was chosen 
GO as to reduce the chances of Hawthorne effects. The specific geographical . 
rer,Ions sampled were chosen because: l) tfiey were larf^e and diverse enough 
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in economic as well as geographical terms; and 2) they were all close 
enough to Mexico City to facilitate classroom observations as well as 
test and survey questionnaire administration. The sampling strategy 
was intended to provide a minimum of 1000 students from each system, and 
because traditional system classes are on the average larger than televi- 
sion system classes, fewer of the former were needed to obtain the desired 
number of subjects. 

Cognitive achievement tests in mathematics, Spanish, and chemistry 
were given at two points in time over a one semester period (February and 
June 1972). Due to resource limitations, this study will only examine 
achievement output in mathematics and Spanish • A general ability test was 
also planned, to be used as a control factor, but administrative difficulties 
prevented it from being given to students in the traditional system. At- 
titudinal data was collected at only one point in time as it v/as felt that 
the time period under study was too short to encompass significant changes 
in attitudes. One of the greatest strengths of this data sample over that of 
similar surveys is the detailed observation data that was gathered on class- 
room interactions and teaching methods (see Mayo (1973) for details). A 
listing and explanation of the variables used in this study is provided in 
Table 2. 

Insert Table 2 about here 



RESULTS 

The results of the before and after achievement testing for Telesecundaria 
and Ensenanza Directa indicate that over the semester period, TG students gained 



TABLE 2 
VAHIAULE LIST^ 



Variable Name 



Student Outcomes 



POST- TEST 



Variable Description 



Raw score on mathematics or 
Spanish post-test 



St udent Previous Learning 
PRE-TEST 



Rav score on mathematics or 
Spanish pre-test 



Community Variables 



STATK -1, ^2, -3 



CO.NMINC 



Dummy variables for the regionfi 

of the Federal District, Valle 

de Mexico, and Hidalgo respecitively 

Average monthly family income in 
the community on a seven-point 
scale - from less than 500 pesos 
to greater than 3000 pesos, in in- 
crements of 500 peso ranges 



Student Background Variables 
SES 



Socio-economic status index based on 
father ^s education and occupation for 
mathematics achievement; index based 
on home possessions (magazines, news- 
paper, books, radio, TV) for Spanish 
achievement 



SEX 

SELFEX 



Student sex; F=0, M=l 

Student self-efficacy index based on 
student's surety of belief that he/she 
will reach her/his educational and career 
goals (NOTE: high index value = lew self- 
efficacy) 



ASP 



Student educational and career aspira- 
tion?; i ndex 



Variable Ncune 



Var iabl e Description 



ATSECUR 



Student desire for financial and 
occupational security index 



MATNEED 



Student desire for material suc- 
cess index 



INIVORLD 



Student belief in the importance 
of being acquainted vrith inter- 
national news and affairs index 
(NOTE; high index value = low 
importance) 



Teacher Variables 



TEASKX 



Teacher sex; F=0, M=l 



TEAED 



Teacher general education and 
teacher training preparation index 



TEAEXP 



Teaching experience index in the 
primary and secondary school system 



TKAGE 
TATED 



Teacher age index 

Teacher attitude toward his/her Job 
and profession in general 



TEAOBS 



Teacher method index, based on class- 
room observation variables; different 
sets of variables compose the index 
for math and Spanish, and TS' and" ED, 
see text and Appendix A for discussion. 



Classroom Variables 



CLSIZE 



Class size 



GROUP 



Television versus non-television; 
TS=0, KD=1 



School facility variables were available, but did not have a significant 
effect on either student mathematics or Spanish achievement. 
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more in mathematics, Spanish, and chemistry than those students in the 
ED system, as shown in Table 3. Given the relatively impoverished home 
and school background of the TS students, it is somewhat surprising to 
note that pre-test scores were quite similar between the two groups, 
although whether this reflects equal inital ignorance about the semester's 
subject matter or the effects of previous learning is impossible to deter- 
mine from the data. ^^insJrrTa^^^ 

A t-test shows the differences in given scores for the two groups 
on all three tests to be significant at the .01 level; if the two student 
groups had been identical except for instructional treatment, it would be 

possible to attribute the difference to the relative effectiveness of the 
25/ 

television system./However, because the TS and ED students differ systematic- 

26 

ally along a number of dimensions, further analysis is needed. One im- 
portant difference which lends greater strength to the test results is that 
TS students on the average come from more educationally and economically im- 
poverished school and home environments than ED students - the TS group gener- 
ally lives in more rural areas where schoo^. resources are fewer, rural elemen- 
tary school teachers generally have less education and teacher training than 
the more urban teachers, families of TS students generally earn less than their 
ED counterparts, and parents of TS students have quite a bit less formal school- 
ing than parents of ED students. 

On the other hand, there are a number of factors, other than the televi- 
sion system - traditional system difference, that might also plausibly account 
for differences in learning gains. One rather simple factor is that the TS 
system has a higher percentage of male students than the ED system (the male- 
female ratio in the TS system is almost 3:1 as op}>osed to less than 2:1 in ED) 



EKLC 
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Table 3 

RcGultG of Do f ova and After Achievement Tecitlpc for 
To3cr;r.»cunc)nrJ a and linV/cnanV^a" D.IVc'cta^ 



Tea er.c cuncVar la ( TS ) 



Subject Matter 




■ Stcl.' Bev . 


Gai'n Score 


No.' "of Students 


Hath 1 (Feb.) 


20.2'l 


'l.8'l 




1,151 


Hith 2 (June) 


213.92 


6.7'l 


+5.68 


• 


Spanish I (Feb.) 


26.39 


6.62 




1,110 


Spanish 2 (June) 


31,130 


b,hi\ ■ 


+5.11 




Chemistry l(I''eb.) 


18.06 


'1.25 




1,132 


Cheniptry 2 (June) 


2i|.31 


6.15 


+6.25 






EnsenanKa Dire 


eta- (ED) 


• 


Subject Matter 


Means 


Std . Dev . 


Gain Score 


No. of Students 


Hath 1 (Feb,) 


20 , 15 


5.02 




836 


Kath 2 (June) 


22 . y6 


5.06 


+2.61 




Spanish 1 (Feb.) 




6.72 




781 


Spanish 2 (Juno) 


27.19 


6.8'l 


+2.65 




Cnomintry l(Fob.) 


10. 'f9 


5.02 




. 713 


t'^cjnifitry 2 (June) 


22.70 


6.27 


+ '1.21 





'From Mayo, McAii;ui>', .'iml Klecs (1075, p. S8) 
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and males may siiaply outperform females, A direct examination of this hy- 
pothesis indicates that although males gain more than females in mathematics, 

equally veil in Spanish, Furthei*more , 
females do/\ TS males achieve more than ED males and TS females achieve more 

than ED females (see Klees(l97M for details). However, it may be that this 
simple comparison is not sufficient in that the education production rela- 
tionship may differ for males and females; this vill "be examined later in 
this section* 

Another hypothesis that might be used to explain the differences in 
learning gains between the TS and ED student groups is that TS students may 
be more able or more motivated to vork and achieve than their KD counterparts. 
The a priori reasoning behind this hypothesis would say that it is more dif- 
ficult for students in rural areas or from disadvantaged backgrounds to suc- 
ceed in school or to continue in school, and that those who do succeed and 

27 

continue are likely to have stronger than average motivation and/or ability, 
Unfortunately, general numerical and language ability test results were only 
obtained for the TS students (due to adirdnistrative problems). However, in- 
direct evidence indicates that ED students would have perfoinned better on 
general ability tests chan TS students - TS results were veil below technical 
secondary school student norms (who are given these same ability tests), and 
technical school students are generally thought to be lower-ability students 
than those in the general secondary school (ED) system, (See Mayo, McAnany, 
and Klees (l973) for further details,) The motivation factor is still a prob- 
lem, though, and vill be treated in the production function discussion thai 
follows, by examining and controlling for the effect of student attitudinal 
variables that may to some extent serve as proxy measures for student motivation* 
Ability differences will be examined in more detail by sample stratification. 



A final alternative hypothesis to. explain the learning gain dif- 
ferences is more difficult to examine - the average class size in the 
ED systeir is twice as large as in the TS system. However, although 
smaller classes are generally considered a 'better educational environ- 
ment' according to traditional wisdom, the research on the relationship 

between class size and achievement doe?, not give any clear indication that 
28 

such is the case. Jamison, Suppes, and Wells (l97M survey the substan- 
tial amount of research done in the United States on this question and 

find the relationship ^'generally weak", although a few studies report that 
small 

^class sizeS'may be significant for young children. Husen (1967) reports on 
the results of an extensive international survey, which generally suggests 
there is no significant difference in achievement between classes of dif- 
ferent size. Despite the above research evidence to the contrary, we will 
attempt to examine the possible effects of class size in the production func- 
tion estimations below. 

Secondary School Production Relationships 

The production function estimated, as discussed earlier, is a raultiplica 
tive model in the form of equation (estimated in the log linear form of 
equation (5)) with mathematics and Spanish achieveinent post-test score as the 
dependent variable. Table h gives the resultant regression coefficients esti- 
mated on the total ED-TS student data set; both ordinary and standardized re- 

29 

gression coefficients are reported. 

Insert Table U about here 



The variable we are most interested in is the GROUP variable; exaiaining 
it we find that even after controll^'.nf^ for sex, motivation (as represented by 



• . TABLK 

PKODUCTIOK FUNCTION FOK MATiimATlCS AND SPANISH ACIIIIWEf'IENT: 

All Students - TS and fJD^ 
VA»TAm,fJ MATH SPANISH VARIABLE' MATH SPANISH 



PRKTKST 


0.3850*** 


0.5258*** 


, MATNEED 


0.0859*** 


0.0292 




( . 0187 ) 


( .0197) 




( .0186) 


( .0205) 




0.3510 


0.5062 




0.0765 


0.021*7 


STATK-1 


0.1137*** 


0.0703*** 


INTWORLD , 


-0.0336*** 


, _ 

-0.0023 




(0. 160) 


{ .0177) 




( .0089) 


(.0098) 




0.191*14 


0.111+3 




-0.0668 


-COOMi 


STA'I'E-2 


0.0992*** 


0.0927*** 


TEASRX 


-0.1025*** 


0.0ll*3 




(.0159) 


(.0181) 




( .0126) 


( .0132) 




0.llt5'4 


0.1292 




-0.1592 


0.0236 


STATE-3 


0.1362*** 


0.01+8^*** 


TEAED 


— . — 

0.3337*** 


0.01*31*** 




(.0153) 


( .0161) 




(.0166) 


( . 0167 ) 




0.1968 


0.0665 




0.1*705 


0.0508 


C0!-V-1INC 


-0.092'»«** 


0.0095 


TEAEXP 


-O.155I**** 


-0.0380*** 










\ . \Je:±y J 


^ . UerOP / 




-Oi 151*9 


0.0151 




-0.1836 


-0.091*'* 


SKS 


0.0020 


-0.017T 


TEAGE 


0.0820*** 


0.0339* 












\ ■ Ui^uy ; 




0.0023 


-0.0197 




0.1080 


0.01*05 


SKX 


0.0067 


-0.0067 


TATH) 


0.0l486**» 


0,1063*** 




(.0100) 


(.0109) 




(.0135) 


(.0156) 




0.0116 


-0.0011 




0.0702 


0.1267 




-0.0333*f** 

(.0097) 
-0.0588 


-O.OI1I46*** 

( .0106) 
-0.071*8 


J. i-Ai\\J DiJ 


(.0089) 
0.1163 


u . up 1 X 

(.OI3I1) 

0.0895 




0.0837*** 

(.0187) 

0.0851 


0.0369* 
( .0206) 
0.0356 


CLSIZE 


0.2167*** 

(.0193) 
0.3637 


0.1388*** 

(.0200) 

0.P2ll( 




GHOUP 


-0.1(011*** 

(.0211) 
-0.7130 


-O.IO56*** 

(.0218) 
-0.3136 




-0.0666*** 
(.0107) 


-0.051*1*** 
(.0117) 




ERLC 


-0.1132 


-0.0873 


CONSTANT 
N 


0.1(780 
1.2702 
1976 


0.1i3lO 
1.31(1*1 

lOyi 



Tlie first nmabcr for each variable represents the estijiuition of the 
ordinar/ regression coefficient. The nuiiber belo\^ in parentheses 
represents the standard error of the estijnated coefficient. The 
third niuDber represents the stiuidardized regression coefficient. 
Level of significance is indicated as follows: 

ft = significant at 85% (t >^ 1.5) 
= significant at 95% (t >. 2.0) 
= significant at 99% (t >, 2»8) 
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attitudinal variables), cla3s size, teacher differences, and other var- 
iables, the television system makes a statistically significant contri- 
bution (at the ,001 level) to student achievement in both mathematics and 
Spanish, The standardized coefficient for GROUP indicates that the contri- 
bution of the television system to achievement is large relative to that of 
other variables, although this is more true in mathematics than in Spanish^ 
It is worthvhile to examine the influence of other variable groups as veil, 

although multicollinearity problems may lead uf> to reject variables that 

30 

are in actuality significant. 

The effects of regional and community variables are somewhat difficult 
to interpret. The shift in the function between states is possibly a result 
of differences in urbanizatioii (a separate urbo.nization variable was included 
in the original sample, but difficulties in coding made its reliability doubt- 
ful; additionally all ED schools are in relatively urban areas). However, if 
this were the case, we might expect the more urbanized regions, the Federal 
District and the state of Mexico (STATE-1 and STATE-2), to show the strongest 

influence. This is true for Spanish achievement, but for mathematics the more 

31 

rural state of Elidalgo (STATE-3) appears to have the strongest effect. The 
not^ative effect of higher community income on mathematics achievement is im- 
possible to explain (there is evidence that the effect of COMMINC changes if 
we stratify by state which indicatf^« som.e type of interactive effect between 
income and region), 

32 

Somewhat surprisingly, student socio-economic status and sex do not 
appear to make a significant difference in achievement, although a number of 
student attitudes do. Low self-expectations (SELP'KX) detract from achievement 
while relatively high educational and occupational aspirations (ASP) and material 
desires (MATNEKD) contribute to achievement, the latter effect probably a result 
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of incrccasing student motivation. It wes also found that the higher a 
student's need for occupational and financial security (ATSECUR), the lower 
the student's achievement and the smaller the student's interest in the 
international vorld (INWORLD), the less is his or her mathematics achieve- 
ment* More detailed analysis of student "backgrcund and attitudinal variables, 
especially in terms of differences between TS and ED students, is presented 
in Mayo, McAnany, and Klees (19T3), although the correlation approach used 
there sometimes show significant effects that do not appear above where co- 
linear factors are controlled for; their results are summarized in Appendix 

A number of teacher-related variables exhibit significant effects on 
student achievement, although not always in the direction that might be ex- 
pected. Male teachers (TEASJ?rc) seem to do signif iea^Titly better than females 
in mathematics instruction. For both mathematics and Spanish, additional 
teacher education and training (TEIAED) result in hig;her student achievement 
scores. The effects of additional teacher experience (TEAEXP) are negative 
hov;ever, even after controlling for teacher age (TFj^LGE) which has a positive 
effect. This finding has been reported in other stiidies of secondary school- 
ing in developing countries (see Carnoy (1973)) and. perhaps indicates a de- 
cline in teacher motivation and/or morale as their ^sxperience in the system 
lengthens. The repercussions of this result e.t'o especially strong when one 
realizes that salary scales are such that teachers receive income increments 

for more experience. One effect of teacher characteristics specific to Tele- 
not 

secundaria, ^examined in the reported regressions, was that favorable teacher 
attitudes toward the television programs had a significant positive effect on 
student achievement in both mathematics and Spanish (although student attitudes 
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toward the TS progroras did not make a difference). 

Classroom observation data on teaching method and types of teacher- 
student interactions provided too many variablec to include each individually 
In this analysis. Instead, a weighted index of selected observation variables 
was designed and 'Jsed. The index was designed to test Mayo's (l973) interpre- 
tation of Beeby's (1966) theory of the positive effect of teacher moderniza- 
tion on student performance. More modern teachers^ according to this inter- 
pretation, are ones that, for example, rely less heavily on lecture and dic- 
tationj ask relatively more thought and opinion, qut^st ions , and tend to move 
towards more individualized types of instruction {see Mayo (l9T3) for details). 
An index based on this construct proved to be a significant factor affecting 
mathematics achievement and is shown in the mathemaliics production function 
as TEAOBS. For Spanish, a number of classroom variables that we had expected 
to influence achievement appeai'ed to have no significant effect or an affect 
in a direction opposite to the direction expected; therefore TEAOBS for Spanish 
represents a post-hoc index based on the few variaJles that had significant 
simple correlations with post-test achievement. 

The problems in interpreting the classroom oljservation data are qui^e 
complicated and beyond the scope of this study. Although Mayo (l973) concludes 
that teaching styles are quite similar for TS and ID teachers , preliminary 
indications suggest that the effectiveness of these styles appear to be quite 
different in the two systems. More analysis is needed in this area; Appendix A 
gives the results of a simple correlation analysis for achievement and classroom 
observation variables* 

Perhaps the most puzzling finding is the higbliy significant , positive 
effect of increasing class size on achievement. At first glance it might seem 



that this would totally disprove the alternative hypothesis that class 
size, not television treatment, is responsible for the different performance 
of the TS and ED students. However, if we separately examine the production 
reltionships for the TS and KD systems (not shown in the tables) we find 
that altnougn class size does continue to have a positive significant ef- 
feet for TS students > its effect on the achievemei.t of YD students is in- 
significant for mathematics and signific£int and negative for Spanish. These 
latter results tend to lessen our certainty in rejecting the alternative class 
size explanatory hypotheses, although the evidence still appears to be on the 
side of the difference in instructional treatment (television vs traditional); 
a comparative analysis of achievement is large size TS classes with all ED 
classes reveals that TS students still gain more both in mathematics and Span- 
ish. One final point that is worth noting is that contrary to recent sentiments 
toward >anclanalysiG of, student achievement in the United States (see Jencks (l9T2) 
and Coleman et.al, (1966)), instructional treatment does seem to contribute to 
the students' achievement gain during the year. Although resources did not 
permit a full ''commonality" analysis of the explanatory power of each variable 
group (see Mayeske et.al* (1969) for methodological details), the stepwise re- 
gression technique employed permitted us to examine the minimum amount of unique 
variance contributed by instructional variables to post-test achievement, after 
controlling for initial position (pre-test score). 



Table 5 



Change In R As Variable Groups Are Added 



Vi 



ariable G^^oup^ 



Mathemritics 



Spanish 



Previous Student Learning 
Community Variables 
Student Background Variables 
Teacher Variables 
Classroom Variables 



.188 
.22? 
.25C 
.38Y 



. 3oO 

.H32 



.336 
.3H9 



a. 



Variable groups are as desci'ibed in Table 2. 
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Table 5 shows us that while community and student background 
variables contribute at most 23% to the variance explained in mathema- 
tics achievement over and above that of pre-test score {i.e. total var- 
iance explained by all variables minus the variance explained by pre- 
test score Is defined as 100^), teacher and classroom variables explain 

^ Qt least for Spanish achievement the comparable figures are 25% 

and 75% respectively. Given the multicollinearity that exists between 
liOn-controllable (community and student background) variables on the one 

hand and instructional (teacher and classroom) variables on the other hand, 

35 

thy latter group may have an even greater effect than indicated above, 
For mathematics, the GROUP variable, expressing the difference between the 
television and traditional system, has the greatest effect of any single 
variable, explaining at least 23% of the additional (to pre-test) variance 
accounted for (TEAOBS is second, explaining l6%) . From Table 5 we can also 
observe that the initial achievement level with which students enter the 
semester has a much greater effect for Spanish than mathematics; indeed, re- 
latively small explanatory power is added by any of the variable groups in 
our model to the initial level of student competency in Spanish. 

Males vs Feinalos 

To further examine the hypothesis that achievement differences between 
TS and K) students may reflect differences in the male-female student body com- 
position of the two systems, separate production relationships were estimated 
for males and females, as shown in Tables 6 and 7* Focaiaining the GROUP variable 
we find that television makes a strong positive contribution to both male and 
female achievement in matlierratlcs and Spanish. Ttio effect of television appearr? 
to be stronger for females than males in mathematics and stronger for males than 
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feraales in Spanish i this may indicate that television has the additional 
benefit (if one views this as a benefit) of equalizing achievement differ- 
ences betveeii males and females, since males are usually found to perform 
better than females in mathematics, and females are usually found to perform 
better in language. 

Insert Tables 6 & 7 about here 

It is also interesting to briefly compare the effects of other variables 
on male and female achievement. By and large, most variables affect male and 
female perfomance aboul. the same. Perhaps a little surprisingly, ve find that 
differences in the effect of teacher sex do not exist for male and female stu- 
dents; male teachers do better for both male and female students in mathematics 
and the sex of the teacher does not seem to matter in Spanish. The most striking 
difference is the absence of an effect of self -expectations and the weakened 
effect of educational and career aspirations for females, indicating that female 
students have other motivations to achieve than male students* 

Low Ability vs High Ability 

Ve have seen that television does appear to contribute to student achieve- 
ment in the Mexican secondary school system ^ hov^ever, it has often been suggested 
that, given the non-individualizable nature of the television mediiuD, programs 
must be aimed at and paced for the students of middle level ability, thus losing 
lower ability students and boring higher ability students* In contrast, a class- 
room teacher is assumed capable of being more flexible, of individualizing the 

being 

content and pace of the curriculum, and therefore^better able to meet the aca- 
demic needs of different ability level students than television. This hypothesis, 
in terms of the effectiveness of television vs traditional instruction on lovr and 
high ability students, will be exoiained below in two ways. 



TADLK 6 

PRODUCTION FUNCTION FOR M^Tiir;MATICG AND 'JPANISII ACHII-ry'fMKNT: 

Male iJtudonts^* 



VARIADI.K MATH SPANISH VAKIAT3LE MATH SPANISFI 



PRETEST 


\ ^1. O V 1# V 


0, y\ho^^^' 


MATNFjW) 


n nt;Ao^# 

U • KJjOd.^ ^ 


0. OJ o2 




( .02li2) 


(.02)11) 






( no^o^ 
\ • KJiiK^y) 




0.3736 


0.5200 




0.0501 


0.015c 




STATE- 1 


0.10l>2*»» 


0.0810*** 


IN-IWRLD 


--0.0356**^ 


-0.0099 




(.015l») 


(0.019)1) 




( .0116) 


(.0122) 




U. I (ic^ 


n Tine: 

0. 1195 




-.n 0707 


n m AA 

— U . UlOO 


STATK-2 


0.0950*** 


0. 08911*** 


TFJVSFJC 


-0.0662*** 


-0.0078 




(0.0lli9) 


(0.0179) 




(.0163) 


(.01610 




0.15Mt 


0.1222 




-0.1003 


-0.0128 


STATE-3 


0.1156*** 


0.0532*** 


TEAED 


0.2679*** 


0.07)i0*»» 




(0.0171) 


(O.OI6I1) 




( .0206) 


(.0202) 




0.181I3 


0.0698 




C.3T30 


0. OODO 


COMMINC 


-0.0lt05** • 


0.0!iOO** 


TEAtXP 


-0.1359**^" 


-0.1172*** 




(.0181) 


(.0178) 




(.0269) 


(.0301) 




-0.0681 


0.061^3 




-0.16^^3 


-0.1300 


SES 


0.0268 


-0.0019 


TEAGE 




0.0512** 




( .0226) 


(.0219) 




( .022?) 


(.0253) 




O.030I+ 


-0.0021 




0.1111 


0.0609 


SEX 






TATED ■ 


O.IOOY 

(*01T0) 

o.ih^6 


0.i532»»» 

(.0193) 

0.181(0 


SELFEX 


-0.0569*** 


-0.0575** 


TFAOBS 


0.0605*'** 


0.0)115** 




( .0130) 


( .0137) 




(.0108) 


(.0157) 


— 


-0.0987 


-0.0953 


. — . — , 


0.1U31 


0.0706 


ASP 


0.0850*** 
( .0232) 
0.0905 


O.OliOij* 
(.O2I1I1) 
0.0!tl2 


CLSIZE 


0.1131''** 

(.025'») 

0.18)16 


^\ n ^ ^^^^^ V 

0.1129*** 

(.0259) 

0.1761 






-0.2921*** 
( .0273) 

0.5156 


-0.2006*** 

( .0269) 

-0.33tt3 


ATSECUH 


-O.O7IY*** 
(.Ol'i5) 

-0. 1182 


-0.0518*** 
( .0152) 

-0. OBlC 


CROUP 


ERJ.C 


CONSTANT 
N 


0. !i636 

1. )i528 

1177 


0.)i5'»3 
l.l'.^)i3 

1123 



'Jlic first luiinbcr for each variable represents the cj^tJiiuition of the 
ordinaiy regression coefficient. 'II10 nnjul)or below in parentheses 
represents the standard error of the cstijnatcd e:ocff icJcnt, Tlie 
third nunil)cr represents tlio standard: /.ed rc^^ression coefficient, 
Level of sjp,nificmice is indicated as follows; 

* « significant at 85t (t >^ 1.5) 
- significant at 95S (t > 2,0) 
^ significant at 99*^ (t >^ 2.8) 



TADr-K V 



• 


PRODUCTION 


[••UNCTION FOH IWrilEl'lATICH AND SPANISH 
Kemalc Gtudents 


ACHICTR^ENTi 




VARIAW.E 


MATH 


SPANISH 


VARIABLE 


MATH 


SPANISH 


rn h 1 tiO i 




0.539'**** 


MTNEED 


0. 1163*** 


0 . 0268 




( .0309) 


( .03't9) 




( .0295) 


( .0336) 




0.31U8 


0.5277 




0,1092 


0.0233 


STATE-1 


. 119 (*** 


.07I43*** 


INTWORLD 








( .0161) 


( .0168) 




(.011)8) 


(.0173) 




.1998 


.1101 




-0.0819 


0.0132 


STATE-2 


. 0900*** 


.1023*** 


TEASEX 




U • U<^4|p 




(.oi6r) 


(.0182) 




( .0216) 


( .0226) 




.1353 


.1336 




-0.2690 


O.OI4OI1 






.01*17*** 


TEAED 


U. UDDf 


u . uooy^ 




(.oiU) 


(.0160) 




(.0300) 


(.0287) 




.2013 


.0617 




0.6802 


0.0802 






0.0lt91* 


TEAEXP 




—u . 1 f pi ^ 




(.0227) 


(.0269) 




(.0392) 


( .Olt70) 




-0.21*95 


0.0770 




-0.2668 


-0.1752 




— U • Ui^^ 


-0.0152 


TEAGE 




u . U f Do 




(.0286) 


(.0278) 




(.0275) 


(.0362) 




-0.0171 


-0.0176 




0.1327 


0.0912 


SEX 






TATED 


0.0!491»* 

(.0217) 

0.0723 


o.oii6i* 
(.026I4) 
0.0539 




u • ui ^0 


-0.0192 


TEAOBS 




U • Uu ( J_ ^ 






(.0175) 






V . u^pu ; 




0.0288 


-O.032I1 




0.1717 


0.1200 


ASP 


0.0895** 

0.0791 


0.0386 

(.0396) 

0.0316 


CLSIZE 


0.3291*** 

0.5681 


0.2lt7l| 






-0.5001*** 

(.0363) 
-0.9001 


-0.1329*** 

(.0379) 
-0.2P13 


A'l'yyCUR 


-0.0757*** 

(.0170) 
-0.1360 


-0.0578*** 

( .0196) 
..0.0962 


GROUP 




R^ 

CONnTAfJT 
N 


O.Ji696 
1.11*92 
756 


0.397'i 
1.0li?7 

7'»9 



'riio first i;uml)cr for cadi variable represents tlie efitimation of the 
oixUnary reiirossion coefficient. The iiuiiiber below in parentfiesos 
represents tliC standard error of the estimated coefficient. The 
third number represents the stiuulardi zed regi-ession coefficient. 
liCVcl of significance is indicated as folloiv's: 

* " significant at 85?o (t > 1.5) 
signifiauit at 951 (t > 2.0) 
= significant at 99i (t >. 2.8) 



Table 8 

Results of Before and After Achievement Testing in the Federal District 



Mathematics TS ID 

pretest 20.28 20.78 

posttest 28»8h 23.80 

gain 8.56 3*02 

N 353 350 

Spanish 

pretest 26. 06 25.37 

posttest 33.22 28.1^4 

gain 7.16 2.77 

N 336 3I1O 



Within the Federal District (including and surrounding Mexico City) 
both the TS and ED systems operate, in contrast to most communities where 
the TS system has entered to fill the void created by the absence of any 
traditional secondary schools. The demand for TS within the Federal Dis- 
trict has resulted in part from the difficulty in entering the crowded tradi- 
tional system (ED). Students in the TS system in this area are generally 
individuals who have failed the entrance examination for the traditional sys- 
tem and generally are considered lower ability students than those in the ED 
system. Exaioining Table 8 we find that these lover ability TS students gain 
significantly more (at the .01 level) in mathematics and Spanish achievement 
than do PID students in the Federal District. However, again we have the problem 
of using a simple t-test to compare populations that may differ systematically 
along other dimensions; therefore the educational production relationship is 
examined below for the Federal District. 



Table 9 shows the results for the production function estimation 
for student mathematics and Spanish achievement in the Federal District » 
Exajnining the GROUP variable we see that television, even after controlling 
for sex, motivation, class size, teacher differences, and other variables, 
has a significant positive effect on the achievement of these lover ability 
TS students. Furthermore, comparing the size of the ordinary regression co- 
efficients here with those of the GROUP variable in Table we can see that 



the na^Sag^ggSSS^ effect of television on achievement^aS^aiEB5«W the same 



<f— — - Examining the remainder of Table 9 we can see that the effectiveness of 
various inputs differ considerably from the average total relationship esti- 
mated earlier (Table h) y perhaps somewhat expectedly due to the differences 
between the urban capital of Mexico City and its less urban surrounding states, 
perhaps in part due to the influence on the sample of the lower ability Tb 
students . 

Generally, teacher characteristics have* effects on achievement in the 
Federal District similar to that in the whole sajnple. One exception is that in 
the Federal District female teachers appear to be more productive than male 
teachers for Spanish achievement as compared to the finding of no significant 
difference between them in the whole sairiple. This may be due to males having 
more higher status alternative employment opportunities in Mexico City than 
elsewhere, with the city therefore having relatively lower quality male teachers 
than in otJier parts of the country. 



IS 




for low ability students as it is for all students. 



Insert Table 9 About Here 



PRODUCTION FUNCTION FOR tlATillWATICS Al(D SPANISI[ A.CHIKV1'MKNT: 
Federal District Students^ 



PRETEST 


0.3313*** 


0.581I9*** 


MATNEED 


O.O29H 


0.0868** 




(.0275) 


(.0321+) 




(.029-'i) 


(.03M() 




0.335*1 


0.53'<0 




0.0269 


O.OT30 


STATE- 1 






INT\y'ORLD 


-0.0357** 

(.0137) 
-0.0726 


0.0073 

(.0157) 

0.0137 


STATE-2 


• 




TEASEX 


-0.1332*** 

(.0196)^ 
-O.2328 


0.1+862*** 

{.0681) 

0.8097 


STATE..3 






TEAED 


0.3873*** 
(.03!tl) 

0 6286 


-0.0052 

{ . 030J+ ) 
-f) nn6? 


COMMIKC 


0.1503*** 


-0.5967*** 


TEAEXP 


-0.583*+*** 


-0.1+905*** 




(.0519) 


(.081+6) 




(.0559) 


(.0515) 




0.1385 


-0, 501+9 




-u • Oo f 0 




SES 


-0.0857*** 


0.0173 


TEAGE 


o.36oi*»* 


0Ji036*** 




(.0267) 


■ (.0363) 




(,0't29) 


(.1002) 






U , Ul'+U 




0. 5307 


0. 5'j05 


SEX 


-0.0089 


-0.0075 


TATED 


0.0502* 


-0.1098*** 




(.0168) 


(.0193) 




(.0276) 


(.031+9) 




-0.015H 


-0,0119 




0.0608 


-0.11+33 


SELFEX 


O.OOlli 


-0.0'i8}+** 


TEAOBS 


o.o6iiM»* 


0,3't59*** 




(.0167) 


(.0198) 






t . O'lDo; 


^- 


0.002!i 


-0.07't2 


* 


0.1Y09 


0.7296 


ASP 


O.ISOM^** 

(.0293) 

0.1326 


-0.0516* 
(.033'0 


CLSI7.E 


( .0563) 
-0.2756 


0, 71*29*** 

(.0899) 

0.8622 






-0.3793*** 

\ . U'l ^0 } 
-0.6912 


-0.1833*** 

( . 03r't / 
-0.3067 


ATSECUR 


-0.07r^5*** 

(.0162) 
-0.1307 


-0.0>62*** 

(.0185) 
-0.0930 


CROUP 


ERLC 


C0N31'ANT 
N 


O.530)t 
3.2lt25 
696 


0.1if!91 
-1 . 9892 
681 



Tlic fh\st junibcr Tor each vajMablc represents tlie cstinu'Jlion of the 
ordinary re^^ression coelTicienl. The number ]>elow in i)arenthcscs 
rcpresoj)ls xho slnndnrJ error of tl)e esLimaled coefficient. The 
tliird nuiiiher rc[)resents tlic standardized reji.ression coefficient. 
Lcv^cl of si{;nif jcancc is indicated as follows; 

ft = significant at 85^; (t >^ 1.5) 
i = sipjiificant at 95% (t > 2.0) 

1 ^^ii: ^ S3{»nificant at 99^ (t >. 2.8) 
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' It also appears likely that the effects of COWING, SES, and CLSIZE 
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are somewhat bound togethei*, measuring the combined effects of community 
status » a student *s relative family status within the community, as well as 
the effect of class size. It is possible to come up with more elaborate ad 
hoc explanations for surprising coefficient signs and magnitudes, but to do 
so would mostly be a fishing expedition; more analysis on various subsamples 
of the data is really needed before we can achieve s real understanding of 
what is taking place* 

In another attempt to examine the effects of television on students 
of differential ability, the sample was stratified into low and high achieve- 
ment students in mathematics and Spanish, low achieipciaent represer^ted by a 
pre-t^3st score greater than one standard deviation ^elow the mean and high 
achievement represented by a pretest score greater ihan one standard deviation 
above the mean. The decision to stratify by achievement was made due to the 

absence of an ability measure for both TS and ED stadents with the implicit 
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assumption that there is a fairly close correlation between the tvo< Actually, 
however > the initial hypothesis of the non-individuelizable nature of the tele- 
vision medium could have been sensibly re^^^arded as Implying that television 
programs were arrived at and geared for middle-level achievement (as opposed to 
ability ) students and thus such programs would lose low achievement students and 
bore high achievement students < 

Insert Tables 10 and 11 aboit here 

Tables 10 and 11 show the resulting prsduction function 
estimates for lov/ achievement and high achievement students 
respectively* Examining the GROUP variable in Table 10, again 
wo find the effect of television to be posittive and significant 



TABLK 10 

PRODUCTION FUNCTION FOR MATIIKMATICH AND GPANISII ACJIIKVI'MPINT: 

Low Acliievcniont Students'^ 



VARIARI.K 


N!ATH 


SPANIOit 


VARIABLE 


MATH 


SPANISH 


PRETUST 


0.0'jJ?0 


0.3583*** 


MATNEED 


0.0385 


0.0873* 




(.O03fO 


(.0705) 




(.0577) 


(.01)72) 




0.0^50 


O.2I135 




0.0330 


0.0856 


STATE-1 


0.1093** 


-o.oo8r 


INT-WORLD 


-0.0316 


0.0258 




(.OMih) 


(.oil 80) 




(.0273) 


(.0267) 




0.1903 


-0.011+7 




-0.0633 


o.o!)98 


STATt;-2 


0.1170** 


O.Oii95 


TRASEX 


0. 03!i5 


0, 0630* 




( .0515) 


( .05'H) 






1 . 0362) 




0.1581 


0.0537 




0.05147 


0.0965 


STATE-? 


0.1988*** 


-O.Oh78 


TEAED 


0.2173*** 


o.iVa*** 




(.01+15) 


(.0392) 




(.01+50) 


(.0505) 


• 


0.3038 


-0.0755 




0.3235 


0.1827 




0 01 0? 






-0.21+61*** 


-0.1505* 




( . o^pyI 


V • ^ Joy f 




(.0699) 


(.0883) 




0.0179 


0. 0^157 




-0.2781) 


-0.1561+ 


SES 


-0.0683 


-0, 003^ 


TEAGE 


0.0876 


-0.1566-** 




( .0528) 


(.0397) 




(.0623) 


( .0660) 




-0.0805 


-0.001(3 




0.1101 


-0.1865 




-0.0113 


-O.OO59 




0. 0659* 


0 1013** 




(.o?86) 


(.0275) 




(.0396) 


( *03QO) 

V * ^ J y ^ t 




-0.020'i 


-0. 0102 




0. 0932 


0.1265 


SRLFEX 


-0.0037 


-0.0605** 


t>:aobs 


0.0689** 


o.09ll(* 




( . 0281 ) 


( . 0260) 




( .0292) 






-0.0067 


-0.1089 




0.1571* 


o.io^r 


ASP 


o.076ii 
(.0578) 


-0.0197 
(.01)95) 


CLSIZE 


0.1867*** 

0.3215 


0.2899 




■0.0773 


-0.02U 
















ATSECL'R 


-0.ili58**» 

(.032Ji) 
-O.f'iiO'i 


-0.1176*** 
(.0332) 

-0.3 839 


GE?01IP 


-0.2819*** 

(.0550) 
-0.5n8n 


-0.128]* 
(.0^67) 

-0.2:^66 


ERIC 


R^ 

coN:;i'AN'i' 

N 


0.3762 
2.1)131 

305 


0.2723 
1.1)638 
397 



*n\o first number for eacl^ variable rc])rcscnts the cslimution oC ihc 
ordinary rc{',rcssion coefficient. The niiiiber below in jiarenthesc.s 
.represents the slanJanl error of the estimated coefficient. The 
third nviinbei' represents the standardized regression coefficient. 
Level of significance is indicated as follows: 

* = significant at 851 (t >^ 1,5) 
significant at 9S% (t >. 2.0) 
Aj^ta = significant at 99% (t > 2,8) 



PROUUCTIOH FUNCTION FOR IWHIimTICIJ AND GPAtllCIl ACHIKVIMKIIT 5 



llit',h Achievement Students'' 
VARTAlil.K MATH SPANIGll VAUTAni.E MATH SPANTSK 



PRKTKST 


0. 5lt)iQ*«* 


0.6609«»* 


MATNEFJ) 


0 . 061 6 


0.0631 




• (.1086) 


(.1162) 




( .0)*21) 


( .01*22) 




0.2?83 


0.33'tH 




0.0657 


0.0760 


STATE- 1 


0.1169*** 


0.0990** 


INTVJORLD 


-0.0257 


-0.0102 




(.0395) 


(.0380) 




(.0189) 


(.0195) 




0.2613 


0.2)193 




0.0630 


0.0281* 


STATf>2 


0.1098*** 


0. 021+7 


TKASEX 


-0.07)19*** 


0.0127 




(.0381) 


(.0387) 




( .0262) 


(.031*0) 




0.2158 


0.0599 




-0.1578 


0.0319 


STATE- 3 


0.0791** 


0.0865** 


TJIAED 


0.2665*** 


0.08ln» 




(.0390) 


( .o!a2) 




(.0377) 


(.0*52) . 




0.1215 


0.1)439 




0.1*323 


0.131*7 


COMMIMC 


-0.1001*** 


-0.0768* 


TEA EXP 


-0.0305 


0.0811 




(.0331) 


(.01*59) 




(.0)*10) 


(.0598) 




-0.2093 


-0.183)* 




-0.01*57 


0.ll»31 


SES 


0.0137 


-0.0861** 


TEAGE 


0.0103 


-O.0I178 




(.0390) 


(.01*06) 




(.0377) 


(.01*21) 




0.0222 


-0.1320 




0.0165^ 


-0.0965 


SEX 


0.0062 


-0.0251 


TATED 


-0.01*6'* 


0.0363 




(.0220) 


(.0230) 




(.0323) 


(.0)(0)*) 




0.0131 


-0.0625 




-0.0839 


0.063)* 


SELFKX 


-0.0109** 


-0.0562** 


TEAOBS 


0.0375* 


0.0216 




( . 0217) 






(.0206) 


(.Olio) 




-0.0921 


-0.1300 




0.1076 


0.05'* 5 


ASP 


0. 0777* 
(.0)165) 
0.0918 


0.0790* 
(.01*60) 
0.1] 09 


CI/SIZE 


0.0766*= 

(.Ol*)*0) 

0.1517 


O.13I1I1*** 
(.O'l'iO) 

0.30lJ( 






-0.2972>:** 

( .Oli6)i ) 
-0.6597 


-o.pnr'O''** 

(.0)159) 
-0.5008 


ATSKCUR 


-0.0978*** 

( . 0226) 
-0.2251 


-O.O2U6 
(.0218) 
-0.06)19 


GROUP 


ERIC 


CONfJTANT 
N 


0.3762 
1.2)187 
357 


0.2918 
0.603)* 
33 2 



BEST CO^Y AVAILABLE 



'llic first number for each varinl)]c rc])rescnls tho estiinatjon of the 
oixliiuny rq^i^cssion coefficient. 'I'hc niuiujer Ijclow in parentheses 
represents ihc standard error of the estLiiated coefficient. The 
third muiil)cr i-cprcscnls Iho standardized rcjiiession coefficient. 
Level of si};ni ficaJicc is indicated as follows: 

1^ ^ significant at (t > l.S) 
- significajit at 95% (t > 2.0) 
^ significant at 99'^ (t >. 2.8) 



for low acliiovemont (ability) students. Comparing the GROUP 

ordinary regression coefficients here with those for the whole 

student sample given in Table 4, we see that television has a 

significantly weaker effect (.01 level) for low ability students 

in mathematics than for students as a v/hole. The effect of 

television on high ability students, as can be seen from Table 11 

is also positive and significant, its effectiveness also being 

significantly lower (.01 level) in mathematics than for the 

average student. Both these results lend credence to the idea 

that at least mathematics television programs are directed toward 

the middle level (achievement or ability) students and thus are 

less effective for lov;er and higher level students • However, 

the important point is that television, in both subjects, still 

aids both low and high level students more than the traditional 
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system appears to. 

It is interesting to note that the proportion of variance 

2 

(R ) in achievement explained by the production function esti-- 
mation is considerably less for low and high level students than 
for students as a whole, that . is, our knowledge of factors 
affecting academic achievement in these students is less than for 
middle level students. We can observe that the influence of 
previous achievement ^PRe-TEST) is quite a bit stronger for 
high achievement students than low achievement students, suggesti 
that we may be relatively less able to influence the academic 
achievement of higher level students. This is further borne 
out by glancing through Table 11 and noting the relative lack 
of significance of most of the instructional system variables. 
Given the present limited degree of school input variation it 
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appcars that television is one of the few school factors that 
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does contribute to the achievement of high level students. 
For low level students we find that school factors, including 
television, do have a significant influence on achicvejuont , while 
there is a general lack of significance of community and 
student background variables. This (combined with low effect 
of PRE--TKST) implies that schools can indeed teach low level 
students; furthermore if we compare the standardized regression 
coefficients of all the factors affecting these students achieve- 
ment the use of television appears to be one of the strongest 
positive influences . 

CONCLUSION S 

We conclude that television as currently used in the Mexican 
secondary school system has a significant positive effect on 
student achievement in tlie core subject areas of mathematics 
and Spanish. Telesecundaria students, despite coming from more 
disadvantaged home and school environments, shov/ larger academic 
improvements in school than Ensenanza Directa students; this 
difference appears to be due primarily to television, as opposed 
to differences in sex, motivation, ability, and class size 
between the two groups. 

We observed that the average production relationships 
estimated changed considerably as the sample was stratified in 
different ways; this goes to illustrate Levin's point (discussed 
earlier-~see Levin (1974)) that average production relationsliips 
are not necessarily production fron t iers an^J that allocative 
efficiency recommendations based on the total data set may yield 
disf uncLional results in certain areas and for certain firms 
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(schools),''^ Indeed; it ic most likely that tlic production 

frontier io different for each individual student (consider the 

student as the "firm") . However, if policy must be applied at 

a more aggregate level (and most often it must) — i*e., the 

classroom, the school, the state, the systeni--then it is tliat 

aggregate level that should bo the relevant level of analysis 

(or base for sample stratification) , despite some possible 
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disf unctional consequences. Perhaps the strongest result of 
the previous analysis is the robustness of the finding" tliat the 
use of television contributes to student achievement; in each 
stratification of the data sample tested, for males and females 
as well as for both high aJ^ility and lov; ability students, 
television was effective. 

Of course, to translate this into even rudimentary policy 
recommendations an analysis of the costs of the two systems are 
needed. As reported in Mayo, McAnany, and Klees (1973) or 
Klees (1974), the TS system, as it nov; operates, costSy on an 
annual per student basis, 25% less than the li:D system — 
$15l/student vo $200/student . The difference in costs is due 
to the lov;er administration, classroom, and teacher costs of the 
TS system more than compensating for the add-on cost of the pro- 
duction, distributi cn , and reception of the instructional tele- 
vision programs. Furthermore, if we compare the two systems 
on a more rational basis than an historical one, .the difference 
in costs becomes even more pronounced; for example, if KD were 
operating in TS's present more rural environment, with average 
class sizes of 23 and single sessions, KD system costs would ))e 
at least $240/student/year and could go as higli as $431/student/year , 

ERIC 



the latter being almost tlircc times the $151/studcnt/year cost 
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of tho TS system. Finally, due to economies of scale the cost 

of the TS system could drop to as low as $130/studont/yGar if 

the system v/as expanded. 

Combining the above cost data with the learning results 

obtained previously and the additional fact that drop-out, 

promotion, and repetition rates are the same for the two systems 

(see Mayo, ricAnany and Klees (1973), and Klees (1974) for details) 

we observe that for an equal level of budget the TS system can , 

enroll more students, produce raore graduates, and increase (or 

at the very least maintain) the level of Spanish and mathematics 

achievement for students enrolled, as compared v/ith the ED 

system. This is what makes Mexico's Telesecundaria project 

especially significant among the many experiments with ITV taking 

place around the world today. Almost all such experiments in 

formal school systems utilize ITV in such a way that it results 
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m larger system costs • 

Very few countries have deliberately reduced the costs of 
the traditional educational system components to m ore than 
offset the additional costs of the television system, as Mexico 
did. Mexico was faced with a shortage of secondary school 
teachers (and schools) available to meet the educational demands 
of rural communities, a situation common to many developing 
nations. At the same time there was an excess (or at least a 
sufficient quantity) of much less expensive, qualified primary 
school teachers (the salary of a primary school teacher is about 
50% that of a secondary scliool teacher) willing to teach in 
rural areas, which although less common, is still found in a 



nmnbor of developing countries. With the simple addition of 

a rather inexpensive/ straight forv;ard^ intensive (and perhaps 
45 

low quality ) instructional television system these two 

apparent deficits were turned into a decided educational advan- 
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tage for the education of rural youngsters, a possibility 
other developing nations may want to investigate. 

Despite the above comparative assets of the TS system a 
few important limitations should be remembered. First, this 
study does not really enable us to examine the effectiveness of 
instructional television programs, except as they were used in 
this system; unfortunately this represents a fixed format, v;ith 
no discernible systematic variations in program quality dimensions 
to allow us to suggest changes in the TS system that might prove 
more effective than current practices. Furthermore, this limited 
variation of educational input patterns does not just apply to 
the use of television; school, classroom, and teacher policies 
and practices are not subject to much variation and it is little 
v/onder that a ''talking head" on television can teach students 
as well (or as poorly ) as a live "talking head" in the class-* 
room. To improve student performance in school and to under- 
stand better the possible effectiveness of scnooling systematic 
experimentation is needed with wide ranges of alternative input 
combinations • 

Finally, there is a growing need for policy-makers and 
analysts to look beyond the useful but limited domain of alter- 
native school system's effectiveness and tackle the more diffi-- 
cult task of examining the possible societal costs and benefits 
of alternative courses of act ion • In the expansion of rural 
O educational opportunities, this need is especially urgent. 

ERIC 



-35- 



Although it is important to learn that Tclosccundaria appears 
to be better able than the traditional secondary school system to 
meet the burgeoning demand for education among rural communities, 
the question of whether it is benoficial to the country (or even 
the individuals involved) still remains. Urban unemployment 
and under-employmont is high and rural and agricultural develop-- 
ment and modernization has barely begun in many areas; a pro- 
gram that encourages the most able and motivated rural students 
to leave their homes and villages and compete for success in 
the cities, as the Telesecundaria seems implicitly to do (see 
Mayo, McAnany, and Klees (1973)), is not clearly in Mexico's 
best interests. 

The problem is not with the technology; television can 
teach, as much research has shovm, and can teach rural Mexican 
students, as this research has shown • People must decide on 
their priorities — perhaps the direct translation of an urban- 
oriented academic curriculum to rural students was an outcome 
of decision-makers priorities of meeting rural educational 
demands, perhaps a curriculum more oriented tov/ard rural develop- 
ment, self-sufficiency, and growth would be more beneficial 
to Mexico's people. Whatever Mexican educational policy-makers 
decide--and the future of the Telesecundaria system is at this 
moment in their hands--it does seem that television can offer 
a viable, useful, cost-effective medium for education for 
Mexico and other developing nations* 



Correlations of Post-^Tcst Aclu.evoniGnt Scores 
With Classroom Ol:)sorvation Variables 



Variable 



TS and ED 



TS only 



ED only 



Ma th G}^ani sh [i^h Spanish ^Iflth Spanish 



Toaclier Uehayior 

Lectures 
Dictates 
Expla j ns 

Asks Procedure Quest. 

Asks Memory Quest. 

Asks Stimulus- Response 
Memory Quest. 

Asks Opinion Quest. 

Asks Research Quest. 

Asks for Examples 

Usos Blackboard 

Uses A-V Materials 

Reads Reference VJorks 

Supervises Individual 
work 

Works Individually With 
Students 

Supervises Groups 

Su<jcjosts Group Projects 

Assigns Hon'.cv/ork 

Assigns Research lIoiaev,'ork 

Checks Iloniev/ork 

Preparation 



25** 



-.16* 



13*** 



- . 32*** 



.38*** .43*** .43*** .39*** 



.21* .19* 
-.16* 



.33*** 



-.33* 



.34* 



-.29* 



.30* 



-.15* -.23* .37* 

.43*** .45*** 



-.3 



-.21** 



-.32* 



Student Dehav ior 

Expounds 
Dictates 

Asks Clarification Quest. 



.25** 



.15* 



.22* 
.24** 



.28* -.30* 



-2- 



Variablo 



TS and ED 



TS o nly 



KD only 



Math Span ish Hath Spanish Math Spanish 



Asks other Quest. 
Gives Opinions 
v:orks Individually 
V.'orks in Groups 
Go To Blackboard 
Time at Blackboard 
Uses A-V Materials 
Uses Textbooks 
Uses Reference Works 



.35*** 
.27** 
.29*** 
.33*** 



.14* .21* 



.35*** 

.30** .33*** 
.31** .16* 
-.14* .35*** 

.22** .26** .19* 



-.28* 



-.30* 

-.37* 
-.43* 



.29* 



Suniiiunry cf Output Results of Tolosocundar ia 
With Iln^cnanzc, Dirccta 

by Mayo, McAnany, and Kloes (3.973, Ctoptcr IV) 



Result 1 ; VJhorcas both IVS and KD groups started r,oro or loss equally, 
trho'Trs cjroups cfainod slicjhtly more over the semester in Mathematics, 
Spanib'ii and Cheraistry, 



Rjej>u^lt_2: Change scores on achievement tests indicate a strong pattern 
of ^s"tate differences , consistent across the three tests. This pattern 
shows jnore cjain in learning in the more url:>an states of DF and Valley 
of Mexico, less in the more rural states of Hidalcjo and Morelos, 

[ability] 

Result 3; TS. students score below the gcneral^level expected of ED 
studen'ts and below the recorded levels of technical secondary stude^nts. 



Re su It 4 : General abili ty results follov/ an identical order by state 
as 'those of achievement; the more urban tlie state, the higher the 
•level of general ability. Also, general ability is strongly related 
to acliieveraent and is one of the single largest factors accounting 
for the variance in acliiovement . 



Res ult 5 : Background factors of parents' education, occupational 
status of the father and TV ownership all relate significantly and 
positively to achievement for the KD^ group. For TS the pattern does 
not hold for achievement but oily for general ability. 



Resu lt 6 ; Background factors of parents' education and fathers^ oc- 
cupation seem to affect achievement for Lp more in urban than in rural 
states; for T G , this influence is limited "to Mexico City, TV owners- 
ship seemed to be related to achievement only for T£ in" tlie more rural 
areas; not at all for KD . 



Re suit 7 ; Although sex and age do not have as strong a relationship 

to achievement as other factors already examined, some consistency 

emerges: younger male students tend to do better in both KID and 'rS 

and v;ithin both groups, age and sex differences on achievei.ient wore 
smaller in the rural areas. 



fi-^^Hj^^t Teacher behaviors that most prompted active student pairticipa- 

tlbn in I'lat hematics sliov/ed a significant relationship v;ith higher achieve- 
ment for both TS and l]p . 

Hojsu^^ Students of both TS^ and r^D liold liigh aspirations for more 

^''choolTng and bettor jobs, but the pFoportions of students desiring 
pD !r"iuvorsity level training and professional careers are much higher in 



Rcsu 1 1 10 : SLudontn with hicfh aspirations (for more school, better 
jobs 'and liicjhor salaries) were in tlie DF and Valley of Mexico, wliilc 
t!)OFJc v/ith lov;er aspirationn v;ero more evident in Hidalgo and xMorolos. 
Tliir> v;aG true of both and HD. 



Result 11 ; flludonts withnore educated parents v;ho liave better jobs 
a)id 'have a television set at hoiae asj^ire to more education, better 
jobH and hicjher salaries. This is true for both groups but the rela- 
tionship is stronger for ED stvidents. 



I^sulJ: 12: Younger students in both systeras aspire for more education, 
but arjcPl's not stronoly related to aspirations. On the other hand, 
boys aspire for much more education, higher status occupations and 
higher salaries than do girls in both TS and ED; hov/ever , girls in 
ED aspire for significantly more schoolTng tlian do girls in TS, 



5£.?iLL!L ' "^'^^ higher the students* general ability and achievement, 
the higher tended to bo their aspiration for more schooling, better 
jobs and higlier salary. Although aspiration tended to be generally 
higher among ED students, the strengtl^ of the relationship betv;een 
aspiration/learning v;as about the satiie for l;oth groups. This pattern 
^ v;as the strongest for rural TS students. 



Result 14; Students of both systems responded in a very similar v:ay 
in the attitude scales although TS students manifested a slight but 
consistent tendency to be loss ch'ange oriented. Such a result may bo 
explained by tlie generally lov/er socio-economic level from which they 
come . 



Result 15 : Students v;ho jrespond in more "modern" or change-oriented 
ways v.'ere more likely to score higher on achievement and (for TS only) 
general ability tests. The relationship between learning and attitudes 
v;as stronger among KjD students. For TS .students, the relationship 
betv;oen "modern" attTtudes and general V.bility was .stronger than that 
betv/een attitudes and achievement, although both v;cre statistically 
significant. 



Result 16; Student attitudes tov;ard TS are generally favorable, but 
Tt remains up to decir>ion--makers to decide what is an acceptable level 
of response before taking remedial action. 



FOOTNOTICS 



Otlicr outputs examinGd include student attitudes, system 
satisfaction of enrollment demand, and system graduates. 
See Mayo, McAnany, and Klees (1973) and Klees (1974) for 
details. 

For a fuller system description see Mayo, MnAnany,,and 
Klees (1973). 

There is in Mexico a shortage of secondary school teachers 
available to teach in rural areas, whereas there was an 
excess of primary school teachers, who cost half as much as 
the. former. In some ways this is the true raison d'etre 
of the TS system. 

For reviews of the relative instructional effectiveness of 
media other than television see Jamison, Suppes, and V7ells 
(1974), Schranun (1973), and Chu and Schrannm (1967). 

They add though, that "some evidence indicates that it 
[television] performs relatively better afc lower grade 
levels." (p. 38). Jamison, et.al. (1974) silso discuss the 
general finding of no significant differcmce in instructional 
effectiveness between television and other instructional 
techniques, com)nenting that "v;hen highly stringent controls 
are imposed on a study, the nature of the controls tends 
to force the methods of presentation into such similar 
formats that one can only expect the 'no significant 
differences' that are in fact found." (p. 36) That is, to 
exact the most out of any instructional msedium, be it 
television or direct teaching, one must allow it to use 
its unique strengths (tor example, Sesame Street). 

For a more detailed treatment of the problems in formulating 
and estimatincj educational production functions see Bowles 
(1970) and Michaelson (1970). Also see Lovin (1974) for a 
critique of their potential usefulness and the relationship 
between output specification and efficiontcy considerations 
discussed below. 

Existing theories of learning are presently too micro in focus 
to be useful to this type of production function analysis. 
Ililgard and Bower (1966) review classical theories of learning 
for pieces of information and connections between these 
pieces. Jamison, Lhamon, and Suppes (1970) review micro 
learning theories in a probabilistic Markov chain framev/ork. 
Brunor (1960) makes a preliminary attempt at developing a 
theory of instruction (as opposed to a theory of learning) . 

For a discussion of a number of the presumed reasons for the 
presence of technical inefficiency in schools see Levin (1971) 
and for a somewhat revised perspective Lovin (1974) • 



VOOTHOTES (Con t i nuod ) 



9, Kquity has become a concern of many contemporary economists, 
although beyond formulatincj rational ways of examining 
equity-efficiency trade-offs, the predominant view is still 
that economists can contribute no more to the definition of 
what is "equitable," than can the ordinary citizen. For 
the examination of equity concerns relevant to the TS and 
ED systems sec Klees (1974). 

10. Allocative efficiency requires that tlic marginal product 
per dollar input of all inputs be equal. See Henderson and 
Quandt (1958) or any otlier standard microeconomics textbook 
for details. 

11. Technical inefficiency becomes an "economic" problem v/hen we 
examine the lack of economic motivation to maximize, 

12. Differences in production possibilities due to these factors 
outside management control have typically been grouped by 
the authors above as part of the problem of technical effi-- 
ciency. Technological efficiency, in essence, is an attempt 
to break down the concept of technical efficiency into factors 
within the control of the firm (technical efficiency as 
defined xn this paper) and those outside the firm's sphere 

of influence (technological efficiency)* It should also be 
noted that these distinctions may change from the short run 
to the long run. 

13. That is, all firms (in an industry) face the same production 
frontier, and all firms operate on that frontier, 

14. This reconwendation v;ould be discernibl^i if teacher moti- 
vation was a measured variable in the production function 
analysis. This type of reasoning has led Levin and Muller 
(1974) to call technical efficiency a misnomer. They assert 
that the physical law of the conservation of energy and matter 
obviously holds, requiring that inputs are not lost in the 
production process; when one finds "technical inefficiency," 
what has iiappened is that appropriate ir^puts have been left 
out of the production function specif ic7:tion (such as teacher 
motivation) or that firm outputs are not appropriately 
specified (e.g. teacher leisure is lacking). Levin (1974) 
goes on to argue th.at production function analysib may be a 
useless tool as different firms will use different inputs to 
produce different outputs. We can carry Levin's argument a 
step further and plausibly suggest that different classrooms, 
and, indeed, different students, can have different production 
functions. Hov;ever, if educational policy is to be applied 

at some aggregate level then it would 53eem to us that on the 
whole production function analysis can yield useful tecommen- 
dations, as discussed below, 

15« Levin's assertion that such recommendations may actually 

reduce total system efficiency rests on output misspocif ication. 
It is irideed true that if, for example, the use of television 



FOOTNOTES (Continued) 



in the Mexican system resv\lts in the reduction of other 
(than mathematics and Spanish achievement) desirable out- 
puts (or in the production of undesirable outputs) its 
use may be disf unctional . 

16. It must be remembered that al locative recommendations 
resulting from production function analysis are ma rgin al 
recommendations; that is^ indications of the effects of 
changes in resource utilization do not necessarily hold 
true for large changes. 

17. Specific formulations of this general model have been 
extended by a number of researchers^ See Levin (197 0) and Carnoy 
(1974) for examples. However, if this is truly the most 
sophisticated model v;e have of the educational process, it 

is evident that our lack of knowledge and understanding is 
great . 

18. The marginal product of any input variable with respect 
to outpvit Y reflects changes in Y caused by small changes in 
Xi ; it is given by the partial derivative of Y v/ith respect 
to X^f 3Y/ bXj^ . In equation (2) this is a constant, b., 

the coefficient of Xj^ . The elasticity of substitution' 
reflects the relative ease v;ith which one can substitute two 
inputs, say for X: , (due to changes in factor price ratios 
or marginal productivity ratios, for example) without sacri- 
ficing output. For a mathematical definition and discussion 
see Michaelson (1970, p. 25) or any standard microeconomics 
text. 

19. The marginal product of variable Xj^ with respect to output 
Y is still the partial derivative ^ Y/ ^ v/hich in the 
logarithmic model equals Y/X^ . 

20. The elasticity of output Y v/ith respect to some input variable 
X is defined mathematically as dY/Y 4" dX^/X^. 

21. Bowles (1970, p. 19) also points out that in the logarithmic 
model "the cross derivatives among any pair of inputs, each 
of which is positively related to output, must also be 
positive. This would require, for example, that an increase 
in the quality of teachers be more effective on cliildren of 
well educated parents than on the children of illiterate 
parents . " 

22 . l/ells ( 197^ ) examines the transcendental logarithmic model 
and several general variable transformation models . 

23. One final consideration not discussed above is the possibility 
of needing a simultaneous system of equations to model the 
educational process v;hen dealing vn th simultaneously produced 
multiple outputs (sec Levin (1970) for a discussion). Duo to 
the short time period under conGidoration in the production 
function estimation (one semester) in this study and the 



FOOTNOTES (Continued) 



subject specific nature of instructional periods at tlie 
secondary school level it was Colt that a sincjle equation 
estimate v/ould suffice. 

24. The author vs^as a member of the Stanford Institute for 
Communication Research evaluation team during this period. 

25. Achievement in chemistry v;ill not be treated further in this 
analysis; the results are included here for the reader's 
information. 

26. The differences between the TS and ED groups are reported 
in detail in Mayo, McAnany, and Klees (1973, Chapter II). 

27. Such students may also have more parental support and encour- 
agement than usual, which is indirectly indicated by the finding 
that despite their more rural situation, TS students had 
similar access to the mass media (newspapers, magazines, 
radio, television and books) in their home or community as ED 
students (see Mayo, McAnany, and Klees (1973, pp. 20-21)). 

28. There is some evidence indicating a positive effect of smaller 
classes on a child's affoc tive development. See Jamison, 
Suppes, and Wells (1974) for a review. 

29. The ordinary regression coefficients may be interpreted as 
the percentage change in the dependent variable associated 
with a one percent change in an independent variable (holding 
all other independent variables constant.) The standardized 
regression coefficients represent the standard deviation 
change in the logarithm of the dependent variable caused by 

a one standard deviation change in the logaritlim of an inde- 
pendent variable. The standardized coefficient is most 
useful as a comparative measure of the strength of the effect 
of one independent variable relative to other independent 
variables, while ordinary regression coefficients can be 
compared between equations (see Schoenberg (1972) for further 
analysis of these dif f erences ) » 

30. Even v;ith multicollineari ty , estimated regression coefficients 
are unbiased estimators. 

31. The effect of the state of Morelos is contained in the con- 
stant term, and is only discernible relative to the effects 
of the other states. 

32. Student socio-economic status and community income are highly 
collncar and this may account for the apparent insignificance 
of SES. 

33. Mayo (1973) does find a few differences in Spanish teaching 
style between TS and Ed teachers, but perhaps of even more 
interest is the finding that TS teachers' sty le "changed 
markedly from one subject to the other Cm<i^^5^^f"<^tics to Spanish]'* 



FOOTNOTES (ContinuG d) 

suocjGstincj that the "nature of the subject matter [may] affoct 
the clasiiroom behavior of the instructorc^ v;ho teach it" 
(p. 17). 

34. Class size may servo as a proxy for degree of urbanization or 
con\munity development, which may be inadequately controlled for, 

35. The nature of the stepwise regression procedure assigns all 
the variance explained in common by two or more independent 
variables to that variable entered first into the regression. 

36. It is possible that all three measure aspects of the same 
phenomena-community urbaiiizat ici'i or development . 

37. For TS students the correlation )^etween relevant ability 
measures and mathematics and Spanish pre--test achievement was 
.34 and .32 respectively. 

38. It might be v/orthwhile, even based on the scanty evidence above, 
to carefully examine the differences botv/een mathematics and 
Spanish television programs in an attempt to understand possible 
differences in the student achievement/ability level toward 
whicli the program is aimed. 

39. Relatively limited variation in educational inputs is a problem 
that plagues this study, as well as other production function 
studies. The effectiveness of the inputs measured only hold 
for variations in them within the range encompassed by the 
sample; the effects of large changes in the organization, 
quality of the inputs cannot be deduced from this analysis. 

40. For example, the production function based on the total data 
set v;ould lead the administrator not to discriminate betv/een 
male and female Spanish teachers. However, in the Federal 
District it might be productive to hire relatively more 
female Spanish teachers. 

41. Of course, it v/ould always be nice to gear policy to the 
differing level of efficiencies of different "firms*' but such 
is not always possible nor necessarily cost-effective (see 
earlier discussion, pp.9"-10). 

42. Another possibility v;ould be to consider the costs of Tele- 
secundaria operating in an urban environment as P:nsenanza 
Directa does now, vv;ith class sizes of 46 and half the schools 
on double session* In such circumstances, TS could cost as 
little as $72/Btudent/year and at most would cost $138/student/ 
year (compared to the present ED cost of $200/student/year) . 
See Klees (1974) for details. 

43. Using ITV as an instructional improvement appears possible, 
and in that case it is a question of v;hcther the extra costs 
associated v;ith it are more tl;an matched by the additional 

•ERjC 
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benefits ITV may provide. However , perhaps the primary 
intmodiate possibilities of the use of ITV (and other 
technological medio) is their ability to reduce costs and 
maintain learning^ if used imaginatively to reduce expen- 
ditures on direct teaching. 

It is not clear what level of education is needed for class- 
room "monitoro" or "coordinators*' if instruction is carried 
mainly by ITV. In Niger, a widely^-acclaimed ITV system used 
primary school graduates as the classroom "teacher-monitor" 
for primary school classes (see Schramm (1973)). 

The quality of the instructional television programs in the 
Mexican system is by most standards considered low. Anyone 
can view the programs by simply turning on their TV set (since 
broadcasts are open circuit, over a commercial network) and, 
therefore, TS has been subject to much criticism. However, 
secondary school teacliers in the traditional system are 
rarely observed by the public and the real question is are 
the tele-teachers as good or better? Furthermore, the tele- 
vision programs are presently produced on a shoe-string budcjet; 
additional money can be spent on improving the quality of the 
programs and the system can still be cost-effective (see 
Klees (1974) and Mayo, McAnany and Klees (1973) for some 
suggc'^tions in this regard) . 

The shortage of secondary school teachers available in rural 
areas allowed many of the teachers union problems to be 
avoided that might otherv;ise be encountered in substituting 
lower paid primary school teachers for higher paid secondary 
school teachers. 

It should be noted that achievement gains for both the TS and 
ED groups were far from spectacular, according to the measures 
used, leading to the possibility that the two systems teach 
equally poorly as opposed to equally well. 
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